SYSTEM AND METHOD FOR ADAPTIVE TRANSMISSION OF 

INFORMATION 



CROSS-REFERENCE TO RELATED APPLICATION 
The present application claims the benefit of U.S. Provisional Application 
No. 60/222,953 filed August 4, 2000. 

FIELD OF THE INVENTION 
This invention relates to a system and method for acquiring, transmitting, and 
reviewing medical or diagnostic information over a network in a manner that reduces 
the data size and associated transmission bandwidth while streamlining the data to 
match clinician workflow procedures. 

BACKGROUND OF THE INVENTION 

There is increasing awareness of the economic and clinical advantages to be 
gained by using a centralized group of "expert" clinicians to review and interpret 
ultrasound or other images acquired at a remote location. A major challenge to 
providing this remote diagnostic capability is the transfer of high bandwidth 
continuous data streams without loss of clinical diagnostic information. 

Current communications infrastructure barely meets the bandwidth 
requirements for real-time image streams and the costs are considerable. For 
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example, the cost associated with installing and maintaining Tl lines to acquire 
sufficient bandwidth are often probative. 

In order for lower cost networking alternatives such as Digital Subscriber 
Lines (DSL) or Integrated Services Digital Network (ISDN) lines to be viable for 
5 clinical image applications, a substantial reduction in the amount of data transferred, 
without loss of clinically significant data, is required. The traditional approach is to 
use conventional data compression techniques to reduce the transmitted data size. 
Using conventional compression methods, however, compression rates higher than 
about 4:1 cannot be achieved without the use of lossy compression algorithms and 
1 0 the associated risk of loss of diagnostically useful information. 

In addition, prior art schemes for the network transmission of clinical data do 
not correlate well with current clinical workflow practices. Resources are often 
wasted by transmitting more information than necessary for effective clinical review, 
or transmitting large amounts of data that is not required for the diagnostic review. 
15 Additional resources such as clinician's time are then typically wasted waiting for 
unnecessarily large images to transmit. 

Furthermore, the views of transmitted data are typically not presented to the 
clinical review in an efficient sequence. For example, in various ultrasound, 
angiogram, x-ray and other image collection procedures a prescribed collection of 
20 views, either single frame or dynamic sequences, are initially acquired with 
additional views acquired if clinically appropriate. The prescribed views are 
typically selected to provide the reviewing physician with an anatomical and/or 
physiological overview. The views are acquired, and transmitted, in the order of 
acquisition which may not be the most efficient clinical review sequence. 
25 Other drawbacks of existing schemes exist. 

SUMMARY OF THE INVENTION 
It is an object of the invention to overcome these and other drawbacks of 
present systems and methods. 
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It is another object of the invention to provide a system and process for 
enabling the acquisition, identification, and adaptive review of clinical diagnostic 
images. 

To achieve these objects and in accordance with the purpose of the invention, 
there are provided a system and method for acquiring clinical image data which 
includes identifying the images acquired with a label that enables the identity of the 
image to be determined. Furthermore, present invention enables adaptive review of 
the sequence of clinical image data under the direction of a reviewing image 
requester. The invention permits select images to be transmitted and/or compression 
of images. 

The accompanying drawings, which are incorporated in and constitute a part 
of this specification, illustrate an embodiment of the invention and, together with the 
description, serve to explain the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The foregoing aspects and many of the attendant advantages of this invention 

will become more readily appreciated as the same become better understood by 

reference to the following detailed description, when taken in conjunction with the 

accompanying drawings, wherein: 

FIGURE 1 is a flowchart illustrating a method for adaptive transmission of 

information according to an embodiment of the invention. 

FIGURE 2 is a flowchart illustrating a more detailed representation of the 

adaptive review step shown in FIGURE 1, according to an embodiment of the 

invention. 

FIGURE 3 is a schematic diagram of a system for implementing the adaptive 
transmission of information shown in FIGURE 1, according to an embodiment of the 
invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
A study of current clinical workflow practices for reviewing diagnostic 
images revealed that clinical reviewers in medical and other applications mentally 
filter images that are judged to be "normal" from the image set, and concentrate 
5 attention on those that do not meet "normal' 1 criteria. The definition of normal varies 
with application and reviewer. 

For example, in cardiology applications, the examination may be reviewed 
from videotape in "search mode." The images are viewed initially at high speed with 
consequent reduction in spatial and temporal resolution. The videotape is only 
10 viewed at regular speed if the anatomy and/or physiology is unclear or an 
abnormality is observed. In this way, the reviewer can condense the 20 minutes of 
videotape recorded from a typical 45 -minute examination to approximately 3 minutes 
of viewing time, for a better than 6: 1 compression rate. 

Similarly, in radiology, 20-40 images may be printed on 6-10 sheets of film, 
15 which are mounted on a continuous viewer running the images past a light box. The 
reviewer scans the image set for images with an "abnormal" appearance, concentrates 
attention on the identified abnormal images, and dictates a report. On 
average, 80-90% of the images from such an examination are deemed to be "normal" 
and therefore otherwise ignored. The reviewer often re-orders the image sequence 
20 for a more efficient review. 

In obstetrics, the ultrasound examination may be reviewed from videotape or 
from a number of image frames on some form of hard copy. In either case, the 
process of separating "normal" from "abnormal" images still applies. 

Based upon these and other observations, the inventor has identified at least 
25 the following five principles that are applied individually or in combination in 
embodiments of the present invention. 

First, many images do not have to be viewed at full spatial or temporal 
resolution in order to be identified as normal and consequently of reduced clinical 
importance. Second, images that cannot be determined as normal or abnormal by the 
30 reviewer when at a lower resolution are viewed at increasing spatial and/or temporal 
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resolution until such determination can be made. Third, the reviewer determines the 
diagnostic significance of images so the reviewer, rather than the acquirer, must 
control the appropriate image resolution during review. Fourth, images should be 
available to the reviewer in the highest acquisition resolution, on demand. Fifth, the 
5 acquisition sequence is not necessarily the optimum sequence for transmission, 
review and/or determination of clinical significance; optimizing the order or 
sequence of views to match review workflow may improve efficiency and reduce the 
~; number of images that must be transmitted. 

jp FIGURE 1 is a flow chart showing schematically an overall process for the 

u\ 10 acquisition and review of clinical images according to an embodiment of the 
invention. As shown, the process may include acquisition of clinical diagnostic 
H images at step 100, identification of the acquired images at step 110 and adaptive 

ri review of the identified images at step 120. It is to be understood that, while 

FIGURE 1 shows sequential steps, in practice the portions of the steps may overlap 
On 1 5 or occur simultaneously. Each step is explained more completely below. 
2 ACQUISITION 

The acquisition step 100 entails the recording of clinical diagnostic images. 
The acquisition step 100 may vary according to the particular diagnostic test and/or 
device being performed and utilized. For example, methods of recording sonogram 
20 images, angio-cardiogram images, x-rays, etc.^ all involve different procedures. 

In any case, once the images are recorded and available in an appropriate 
format, they may be loaded into a suitable file or service providing device, such as a 
server or retrievable storage device (for example, the system 10 in FIGURE 3). 

The images may be loaded in any suitable fashion, as are well known in the 
25 art. For example, some embodiments of the invention may include a direct 
connection (hard-wired or wireless) between the clinical imaging device and the 
server so that the clinical images are simultaneously loaded into the server as they are 
being acquired. Other alternatives, by way of non-limiting example, include: storing 
recorded images on a suitable processor readable disc {e.g., hard disk drive, floppy 
30 disk drive, zip disk drive, etc.) for later loading onto the server; producing hard 
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copies of the images {e.g., developing x-ray film); and scanning hard copy into 
digital form for loading. The present invention may be implemented using any 
suitable method of loading digital images onto the server. 

It is also noted that the images will typically be recorded in a manner suitable 
5 to the diagnostic application. For example, a clinician may record images as single 
frames or dynamic sequences as desired or appropriate to the examination being 
performed. 

In some embodiments, the data may be stored in a lossless form. Preferably, 
the data is stored losslessly, or at least without the loss of clinically important data, 
10 by implementing the procedures described in the co-pending provisional application 
by the same inventor titled, "Method and Apparatus for Providing Clinically 
Adaptive Compression of Image Data, 11 U.S. Provisional Application 
No. 60/222,952. 
IDENTIFICATION 

15 The identification step 110 entails labeling the acquired images so that 

individual images may be identified. In some embodiments of the present invention 
the images may be identified by a predefined label. Images may be labeled as they 
are acquired, as they are loaded on the server, in batch mode after loading, or at 
another appropriate time. Labeling the images enables a reviewing physician to 

20 request specific views or images if desired or to facilitate transmission of images in 
the most relevant and/or efficient sequence. 
ADAPTIVE REVIEW 

The adaptive review occurs at step 120. The adaptive review 120 occurs 
when a requester (for example, a physician or other image interpreter) makes a 

25 request for network image delivery. Upon request, the system provides images to the 
requester in an efficient, feedback responsive manner that is controllable by the 
requester. 

One embodiment of the invention may be described with reference to the 
following example wherein a physician (requester) makes a request to review 
30 diagnostic ultrasound images. As discussed above, the reviewing physician screens 
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the ultrasound images for "normal" appearance and concentrates on those that are 
either unrecognized or "abnormal" It is not always necessary for the images to be at 
maximum resolution to determine that a given image is normal or abnormal. 

Referring now to FIGURE 3, initially, requested images are forwarded by a 
5 server 12 to a review station 14 in a compressed form that is preselected to optimize 
transmission time and quality. It will be readily apparent that the highest quality 
images, that is, images with the highest temporal and/or spatial resolution, will be the 
O largest and therefore require more transmission time. Therefore, an optimal balance 

yp between transmission time and image quality will exist. In this embodiment, for 

I* 10 example, only the first frame of a dynamic sequences is forwarded at this time. In 
N! this manner, the physician is able to obtain an overview of the available images in a 

y f scrollable area of the review station 14 display relatively quickly. While the 

L, physician is reviewing these overview images, the remaining frames of any dynamic 

PD sequences may be compressed and forwarded. 

5n 15 In a preferred embodiment, the reviewing physician may interrupt this 

^ process at any time by selecting one or more images for closer inspection. If the 

selected images are from a dynamic sequences, then the server 12 may transmit any 
remaining frames for those images while the first frames are under review at review 
station 14. The additional frames may be forwarded using an algorithm to minimize 
20 the transmission delays. 

For example, in a preferred embodiment when additional frames are 
requested, server 12 transmits the middle frame of a dynamic sequence an index 
frame) and a frame on either side of the indexed frame (e.g., frames 5, 10, 15). 
Intermediate frames are then transmitted to "fill in" the data set. This scheme 
25 presents the physician with an increasingly more detailed view of the examination, 
by continually bisecting the selected range of full frames. In other words, 
frames 5, 10, 15 are transmitted first, then frames 7 and 13, then frames 6, 8, 12, 14, 
and finally frames 9 and 11. In some embodiments, this fill process may continue 
until the reviewer signals that sufficient data has been received. The optimum 
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sequencing may be linked to clinical application and network parameters for 
optimum performance. 

In some embodiments, the reviewing physician may also request the images 
in a less compressed form, up to the lossless form stored on the server. In other 
5 words, the physician may not immediately desire additional images in the sequence, 
but rather that a higher resolution copy of the image currently displayed be sent. 
Alternatively, the physician may request that the entire sequence be sent at higher 
resolution. 

It is contemplated that in many cases, particularly normal studies and routine 
10 follow up, full resolution images are never requested for all views. However, in a 
preferred embodiment the full resolution images are available on demand and under 
the control of the reviewing physician. 

In some embodiments of the present invention, the reviewer may elect to 
archive reviewed images. In these embodiments the selected images may be 
1 5 retrieved from the stored full resolution set and transmitted to an appropriate archive. 
An archive may be located at the same location as the reviewing station 14 or at any 
other suitable location. 

FIGURE 2 presents a more detailed representation of adaptive review 
step 120 according to some embodiments of the invention. As indicated, adaptive 
20 review 120 begins with an image request at step 1200. Step 1202 determines 
whether the image request is for a static image (for example, an x-ray) or a dynamic 
sequence of images (for example, a sonogram scan). 

If the request 1200 is for a static image, the system 10 causes a compressed 
image to be transmitted over the network 16 at step 1204. As described herein, the 
25 image may be compressed according to preselected criteria to optimize resolution 
and transmission efficiency. 

The system 10 checks for a request for closer inspection of the image at 
step 1206. If no such request is received, the system 10 returns as indicated at 
step 1208. If a closer inspection request is received at step 1206, the system 10 
30 causes a more detailed (higher resolution) version of the image to be communicated 
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at step 1210. The system 10 may loop as indicated until no more request are 
detected. 

If the request at step 1200 is determined at step 1202 to be for a dynamic 
series of images, the system 10 causes a compressed first frame to be communicated 
5 to review station 14 at step 1212. Again, compression is preselected to optimize 
transmission time and image resolution. 

While the first frame is presented for review at step 1212, the system 10 
& ! causes the remaining images in the series to be compressed and forwarded at 

Ji step 1214. 

rj 10 The system 10 also checks for requests for closer inspection at step 1216. 

Again, if none are received, the system 10 may return as indicated at step 1218. 
M, Otherwise, the system 10 may send additional frames in the series, or frames of 

L greater resolution at step 1220. The system 10 may loop as indicated until no more 

CO requests are detected. 

Tj 1 5 FIGURE 3 illustrates a system 1 0 according to an embodiment of the present 

invention. As shown, system 10 includes a server 12. The server 12 may include any 
service and file providing processor device suitable for processing client device 
requests. 

While a single server 12 is indicated in FIGURE 3, multiple servers, 
20 distributed servers, or other suitable configuration of servers may be implemented. 
The system 10 also includes a review station 14. The review station 14 includes a 
suitable client device for accessing the server 12 over the network 16. For example, 
review station 14 may include a network terminal, a processor workstation, a 
personal computer, a portable computer, a personal digital assistant, a Web-enabled 
25 cellular phone, an Internet compatible television, or other processor device. 

The server 12 and the review station 14 communicate over the network 16. 
The network 16 may comprise any interconnected processor network. For example, 
network 16 may comprise a local area network, a wide area network, the Internet, an 
intranet, or other suitable network. Communication over the network 16 may be 
30 accomplished in a wired or wireless fashion. 
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The system 10 may also include an acquiring station 18. The acquiring 
station 1 8 may comprise a diagnostic device capable of producing diagnostic clinical 
images suitable for transmission over network 16. For example, acquiring station 18 
may comprise an ultrasound device, an angio-cardiogram device, an x-ray device, a 
5 magnetic resonance imager, or other suitable imaging device. As indicated in 
FIGURE 3, the acquiring station 18 may communicate over the network 16 or, as 
indicated by dashed line, directly with the server 12. 

The system 10 also may include an archive 20. The archive 20 may comprise 
a suitable storage device capable of storing selected images. The dashed box 

10 representation of the archive 20 indicates that archive 20 may be located at any 
suitable location. For example, the archive 20 may be located at the review 
station 14, at server 12, or at another location in communication with the network 16. 

As described herein, the invention may reduce the size of the data actually 
transmitted by as much as 30:1 or more in addition to the lossless compression 

15 of 30:1 afforded by Clinical Adaptive Compression, as described in co-pending 
provisional application titled, "Method and Apparatus for Providing Clinically 
Adaptive Compression of Image Data," by the same inventor, U.S. Provisional 
Application No. 60/222,952. This data reduction and/or compression makes the 
transmission of echocardiography exams over standard Internet connections a 

20 practical proposition. 

Assuming a typical digital acquisition protocol for a routine echocardiogram 
examination comprising 16 views of 4 cardiac cycles and a heart rate of 60 beats per 
minute. At a frame rate of 30 Hz, this would be 120 frames per view or 1,920 frames 
total. If each frame is 900 kilobytes, the relative data sizes would be as shown in 

25 Table I below: 
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Table I 



Data Format 


Approximate Size 


Compression 


Time to transmit 
by ISDN 128kbs 


Uncompressed 


1.8Gbytes 
(1,800 Mbytes) 


0 


>30 hours 


Standard Lossless 
Compression 


450 Mbytes 


4:1 


8 hours 


Clinical Adaptive 
(Compression lossless) 


60 Mbytes 


30:1 


1 hours 


With Workflow 
Adaptive Review 


4 Mbytes 


360:1 


4 minutes 



Assuming that the reviewer requests a single frame for every view as an 
overview and 5 views of 30 frames (1 cardiac cycle) in detail, even if the reviewer 
5 requested more detail frames, say 25%, for example, the total time to transmit and 
review would still be less than 15 minutes using this approach. 

By comparison, using industry standard compression techniques the data 
sizes would be as indicated in Table II: 

10 Table II 



Data Format 


Approximate Size 


Compression 


Time to Transmit 
by ISDN (128 kbps) 


Uncompressed 


1.8 Gbytes 
(1,800 Mbytes) 


0 


>30 hours 


Motion JPEG (DVS) 


120 Mbytes 


15:1 


2 hours 


MPEG-1 


30 Mbytes 


60:1 


30 minutes 


Clinical Adaptive 
Compression (compact) 


18 Mbytes 


100:1 


1 8 minutes 


With Workflow Adaptive 
Review 


1.5 Mbytes 


1200:1 


1 .5 minutes 



Other embodiments, uses, and advantages of the present invention will be 
apparent to those skilled in the art from consideration of the specification and 
practice of the invention disclosed herein. It is understood that the present invention 
15 may be used with any image where the content and layout is known by the 
compressor, such as seismographic images, x-rays of inert objects, or other types of 
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images. The specification and examples should be considered exemplary only. The 
intended scope of the invention is only limited by the claims appended hereto. 

While the preferred embodiment of the invention has been illustrated and 
described, it will be appreciated that various changes can be made therein without 
departing from the spirit and scope of the invention. 
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